Gaussian Processes for regression: a tutorial

نویسندگان

  • José Melo
  • Roberto Frias
چکیده

Gaussian processes are a powerful, non-parametric tool that can be be used in supervised learning, namely in regression but also in classification problems. The main advantages of this method are the ability of GPs to provide uncertainty estimates and to learn the noise and smoothness parameters from training data. The aim of this short tutorial is to provide the basic theoretical aspects of Gaussian Processes, as well as a brief practical overview on implementation. The main motivation of this work was to develop a new approach to detect outliers on acoustic navigation algorithms for Autonomous Underwater Vehicles, capable of adjusting to different operation scenarios, since this is a major problem in the majority of Autonomous Underwater Vehicles. In the last part of the tutorial, a brief insight on this actual problem, and the solution proposed, that involves Gaussian Processes as a predictor, and some background subtraction techniques is described.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Prediction with Gaussian Processes : from Linear Regression to Linear Prediction

The main aim of this paper is to provide a tutorial on regression with Gaussian processes. We start from Bayesian linear regression, and show how by a change of viewpoint one can see this method as a Gaussian process predictor based on priors over functions, rather than on priors over parameters. This leads in to a more general discussion of Gaussian processes in section 4. Section 5 deals with...

متن کامل

Prediction with Gaussian Processes from Linear Regression to Linear Prediction and Beyond

The main aim of this paper is to provide a tutorial on regression with Gaussian processes We start from Bayesian linear regression and show how by a change of viewpoint one can see this method as a Gaussian process predictor based on priors over functions rather than on priors over parameters This leads in to a more general discussion of Gaussian processes in section Section deals with further ...

متن کامل

The Rate of Entropy for Gaussian Processes

In this paper, we show that in order to obtain the Tsallis entropy rate for stochastic processes, we can use the limit of conditional entropy, as it was done for the case of Shannon and Renyi entropy rates. Using that we can obtain Tsallis entropy rate for stationary Gaussian processes. Finally, we derive the relation between Renyi, Shannon and Tsallis entropy rates for stationary Gaussian proc...

متن کامل

Boosted Regression (Boosting): An introductory tutorial and a Stata plugin

Boosting, or boosted regression, is a recent data mining technique that has shown considerable success in predictive accuracy. This article gives an overview over boosting and introduces a new Stata command, boost, that implements the boosting algorithm described in Hastie et al. (2001, p. 322). The plugin is illustrated with a Gaussian and a logistic regression example. In the Gaussian regress...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012